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PROPERTIES OF MULTIPLE INFORMATIONAL ITEMS 

Reference to Related Applications 

This application is a continuation in part of PCT Application Serial No. 
PCT/USO 1/087 10, which was filed March 16, 2001, entitled PRIORITIES 
GENERATION AND MANAGEMENT and of PCT Application Serial No. 
PCT/USO 1/0871 1, which was filed March 16, 2001, entitled NOTIFICATION 
PLATFORM ARCHITECTURE, both of which claim the benefit of U.S. Provisional 
Patent Application Serial No. 60/189,801, which was filed March 16, 2000, entitled 
ATTENTIONAL SYSTEMS AND INTERFACES. This application also claims the 
benefit of U.S. Provisional Patent Application Serial No. 60/212,293, which was filed 
June 1 7, 2000, entitled SCOPE USER INTERFACE FOR A NOTIFICATION 
PLATFORM. 

Technical Field 

The present invention relates generally to computer systems, and more particularly 
to a system and method to provide a non-intrusive, glancable and updateable interactive 
interface associated with a notification platform architecture, wherein prioritized 
information or notifications and/or indications thereof are rendered across various classes, 
domains and/or sources of information and communications. 

Background of the Invention 

With the growth of computer and information systems, and related network 
technologies such as wireless and Internet communications, ever increasing amounts of 
electronic information are communicated, transferred and subsequently processed by 
users and/or systems. As an example, electronic mail programs have become a popular 
application among computer users for generating and receiving such information. 
However, with the heightened popularity of e-mail and other communications systems, 
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problems have begun to appear in regard to managing and processing increasing amounts 
of information from a plurality of sources. 

Among these problems, many users now face a deluge of e-mail and/or other 
information to sort through, manage and/or respond to, such that the capability of being 
5 able to send, receive and process information has almost become a hindrance to being 

productive. For example, some users report receiving over 100 e-mail messages a day. 
With such large numbers of received electronic information, it has thus become difficult 
to manage information according to what is important and what is not as important 
without substantially expending valuable time to make a personal determination as to the 

1 0 importance of each received piece of information. As an example of these 

determinations, users may have to decide whether messages should be responded to 
immediately, passed over to be read at a later time, or simply deleted due to non- 
importance {e.g., junk mail). As can be appreciated, having to personally inspect and 
determine whether a plurality of received items should be responded to or discarded can 

1 5 take valuable time away from more productive activities. It also can be a distraction to 

continually check and peruse an inbox, for example, regarding messages that are received 
over time. 

Summary of thp Tnvpntinn 

20 The following presents a simplified summary of the invention in order to provide 

a basic understanding of some aspects of the invention. This summary is not an extensive 
overview of the invention. It is intended to neither identify key or critical elements of the 
invention nor delineate the scope of the invention. Its sole purpose is to present some 
concepts of the invention in a simplified form as a prelude to the more detailed 

25 description that is presented later. 

The present invention relates to a system and methodology to provide a glancable, 
interactive user interface associated with one or more prioritized items. These items, 
which can come in the form of information or notifications, and can be received from 
external sources and/or from a notification system, wherein priorities can be assigned by 

30 the sources and/or automatically determined by a prioritization system. The notifications 
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are then arranged and/or located in a graphical display according to the assigned 
priorities, thus enabling a user to quickly glance at the display and determine how many 
items are pending, where items have originated from, and what urgency level is 
associated with respective items. Other informational properties of the items may also be 
5 included in the form of graphical and text features, some of which may be revealed upon 

user interaction, whereby users employ one or more gestures or actions to access or filter 
the informational items in one or more ways. Various shapes, locations, colors, and 
sounds are utilized in a variety of ergonomic configurations to enable users to easily 
manage a plurality of information sources. A default display can be provided that 
1 0 presents an overview of pending notifications, for example. Through interaction, the user 

can obtain increasing detail of information about displayed notifications as suitable to the 
type of the item. 

The present invention enables information and communications systems to 
transmit maximal amounts of information about the state of one or more items with 

1 5 minimal user disruption by providing a centralized user interface for information and 

notifications, and by adapting the saliency of information and notifications depending on 
the assigned priority. This can be achieved utilizing techniques such as fading, 
highlighting, and/or audio feedback, for example. Other features of the interface can 
include instant replay of prior item arrivals, force directed layouts, crystal balls, three- 

20 dimensional renderings, and/or radar views of notifications such as can be arranged in a 
circular-radar or on a horizon, for example. In addition, input from the user interface can 
be monitored by a notification or priorities system as feedback for training these systems 
in accordance with what the user considers important and/or less important notifications. 
The following description and the annexed drawings set forth in detail certain 

25 illustrative aspects of the invention. These aspects are indicative, however, of but a few 

of the various ways in which the principles of the invention may be employed and the 
present invention is intended to include all such aspects and their equivalents. Other 
advantages and novel features of the invention will become apparent from the following 
detailed description of the invention when considered in conjunction with the drawings. 

30 
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Brief Description of the Drawings 

Fig. 1 is a schematic block diagram of a user interface and notification/priorities 
system in accordance with an aspect of the present invention. 

Fig. 2 is a block diagram illustrating a user interface and associated methods in 
5 accordance with an aspect of the present invention. 

Fig. 3 is a flow diagram of a methodology for displaying objects in accordance 
with an aspect of the present invention. 

Fig. 4 is a flow diagram for mapping display objects in accordance with an aspect 
of the present invention. 

1 0 Fig. 5 is a diagram of an exemplary scope display in accordance with an aspect of 

the present invention. 

Fig. 6 is a diagram of an exemplary of three dimensional scope display in 
accordance with an aspect of the present invention. 

Fig. 7 is a top view of a three dimensional scope display in accordance with an 
1 5 aspect of the present invention. 

Fig. 8 is a diagram of a scope being unlocked in accordance with an aspect of the 
present invention. 

Fig. 9 is a diagram of an alternative unlocked scope in accordance with an aspect 
of the present invention. 

20 Fig. 10 is a diagram illustrating alternative arrangements of sectors on the scope 

surface into which informational items can be grouped in accordance with an aspect of 
the present invention. 

Fig. 1 1 is a diagram illustrating alternative scope displays in accordance with an 
aspect of the present invention. 
25 Fig. 12 is a diagram illustrating a partly expanded sector and display objects in 

accordance with an aspect of the present invention. 

Fig. 13 is a diagram illustrating a fully expanded sector and display in accordance 
with an aspect of the present invention. 

Fig. 14 is a diagram illustrating a highlighted display object in accordance with an 
30 aspect of the present invention, as well as an early moment in the appearance of a detail 
display for an information item, continued in Fig. 15. 
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Fig. 15 is a diagram illustrating an animated display in accordance with an aspect 
of the present invention. 

Fig. 16 is a diagram illustrating an animated display in accordance with an aspect 
of the present invention. 

5 Fig. 17 is a diagram illustrating a crystal ball view of a notification in accordance 

with an aspect of the present invention. 

Fig. 18 is a diagram illustrating a display object with additional detail in 
accordance with an aspect of the present invention. 

Fig. 19 is a schematic block diagram illustrating a suitable operating environment 
1 0 in accordance with an aspect of the present invention. 

Fig. 20 is a schematic block diagram illustrating a suitable operating device in 
accordance with an aspect of the present invention. 



Detailed Description of the Invention 

1 5 The present invention relates to a system and methodology providing a 

configurable and adaptable user interface for interacting with a plurality of notifications. 
This can be achieved by providing a visual overview of incoming information, making it 
clear at a glance how many items associated with an inbox, for example, are waiting for a 
user, how important the items are, and what main areas of life and/or work the items 

20 pertain to. The user interface of the present invention is glancable since it provides an 

overview display; unifies multiple sources; and locates important items in the center of 
the display, for example, to enable a singular point of focus. According to one aspect of 
the present invention, the interface can be represented as a circle or other shape that 
resides in the corner or other area of a desktop display screen, possibly transparently 

25 blended over other windows, or potentially presented in a faded/translucent manner. 

Because of the compact nature of the display, it is also well suited to alternative 
computing and/or communication devices, such as cell-phones with large displays, 
watches with large displays, and Personal Digital Assistants (PDA's). This provides an 
interface for notifications or other information that is consistent across multiple electronic 

30 devices. Accommodations are made, with particular devices and for different types of 

input modalities. While mouse interaction may function effectively on a desktop 
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computer, a PDA can utilize a different form of interaction such as quick inspection via a 
small number of hardware buttons on the device itself. When an input device such as a 
mouse has selected the interface, or when the interface has received urgent information, 
for example, the interface can solidify into a radar screen or other configuration, for 
5 example. 

The interface provides an organizational metaphor, wherein information is 
directed at users from various directions and information sources, and indicates what is 
presently important. A priorities system can be provided that assigns an 
urgency/importance rating to incoming notifications/items received from a plurality of 

10 sources, thus enabling arrangement of the items according to one or more non-distracting 
and user- friendly renderings. For example, urgent items can be located closer to the 
center of the interface enabling users to quickly glance over less important items. These 
items can also be grouped according to one or more sectors {e.g., radially) by domain, 
grouping together work-related items, family items, news headlines, and so forth. 

1 5 Alternatively, items can be grouped into sectors according to the origin or delivery 

medium of a notification such as the type (e.g., e-mail, instant message, news item, voice 
mail, appointments, tasks with deadlines, proximity of friends, and so forth). The display 
items may be rendered in the shape and/or color of the associated wedge or shape, for 
example. Furthermore, the interface can be adapted such that whenever a user glances at 

20 the interface, it can distinguish newly added items. 

Generally, text is not shown on the interface display, until an action such as a 
mouse-over occurs over selected display objects, however, items displayed on the 
interface can reveal summary information when inspected, and opened when clicked, for 
example. However, in some versions, textual properties can be included. The interface 

25 can provide handles for controlling both the display and the more general rendering of 

communications. For example, the display can serve to enable users to control when 
incoming items should cause an audible and/or visual notification, for example. This can 
be achieved via a "swipe out" of a region around the center of the display, for example, 
that represents a high enough priority that indicates that the user desires to be interrupted. 

30 Messages or notifications that arrive in this region can cause an alert. Thus, the priority 
threshold for alerts can be adjusted with a manipulation of a context of a current 
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overview, for example, rather than with an abstract priority level or number. Category 
wedges or sectors can also be modified with user directed manipulation. Thus, users can 
drag new "magnets" onto the interface which will influence item placement based on 
affinity with the magnet, type a label, and drag and drop to re-arrange the size and 
5 ordering of the shapes. 

In view of the above, the present invention provides an easy overview, inspection- 
at-a-glance interface. This can be achieved via "light-weight to render" vector graphics 
that are rasterized into bitmap graphics at run-time. Thus, the interface can be compacted 
to fit on a portable personal computer or other hand-held device such as a cell phone or 

1 0 watch. Extendibility can also be provided in accordance with the present invention. For 

example, "Fish-eye" techniques can be included for interface scalability. A selectable 
distortion can be provided to enable more space for one sector but preserve relative 
placements within the sector. The interface can also be augmented with a first-person 
view with items arranged as approaching the user. This augmentation can also occur 

1 5 with time stretching in a 3rd dimension, for example, whereby the user looks back in time 

for a history. 

According to other aspects of the present invention, items such as wedge/section 
objects can be animated when expanded for more detail, for example. Substantially every 
item to be displayed can be animated, wherein appearance animation can be utilized when 
20 a new item is added or if the display is changed when inspected. Items can have "visual 

annotations" that distinguish properties of the item they represent. This splits into a 
primary item type, determining the major appearance, and the "annotations", adding 
detail. Associated data employed can include: Item type or domain type; newness, 
summary of message content, type of addressee (e.g., only the current user, as opposed to 
25 a large mailing list), type of sender (e.g., a manager or co-worker, a contact found in the 

user's electronic address list, an unknown address), whether the message is part of an 
ongoing exchange, and so forth. 

Other aspects can include normalizing an axis of priority across sectors, or 
varying by sector according to the density of higher priority items. Generally, a non- 
30 rectangular window is utilized for display however a plurality of shapes and sizes can be 
employed. For example, a wedge can be collapsed down to a radial line with glommed 
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items displayed on it, thus depicting the distribution of items across a priority dimension 
in the collapsed wedge. Meeting, Task or other items, for example, can also be 
prioritized depending on the amount of work (or prep work) to be done. 

Referring initially to Fig. 1, a system 1 0 illustrates a user interface 20 in 
5 accordance with an aspect of the present invention. The user interface 20 receives a 

plurality of prioritized notifications 22 from a notification manager 24 and provides 
visual, audio and/or physical {e.g., vibration) renderings to a device such as a computer 
display screen or hand held device such as an electronic wristwatch, a personal digital 
assistant or cellular phone. A priorities system 30 can be provided to assign a priority or 
10 urgency factor to one or more notifications 32 that can be received from a plurality of 
information sources (not shown). It is noted that the priorities system 30 can 
automatically assign priorities to the notifications 32 via an automated system and/or can 
assign priorities via a manually determined system such as by a subscription service, for 
example. 

1 5 Based in part upon the assigned priorities, the user interface 20 provides an 

organizational framework or metaphor in which to display or render the prioritized 
notifications 22 over time. The display/renderings are depicted as an output 36 that is 
directed to the user. For example, the output 36 can appear as an unobtrusive, translucent 
and/or transparent display while the user is busy or working and is selectable to become 

20 non-transparent/translucent if the user desires to observe notifications and/or notification 

activity. Context monitors (e.g., camera/microphone inputs, calendar, clock) that are 
described in more detail below can be provided that alter the display (e.g., transparent to 
active foreground display) based upon the sensed activity or context of the user and/or 
assigned priority/source/domain of the notifications 32. 

25 The display can be arranged according to one or more sectors that can further be 

arranged, shaped and colored according to the source of the notifications 32 (e.g., e-mail, 
voice mail, instant messaging) and/or can be arranged, shaped and colored according to a 
domain that defines how the message pertains to the user (e.g., work, family, hobby, 
financial). The one or more sectors of the display can be grouped, wherein the grouping 

30 of sectors is further categorized or partitioned according to the priority of the prioritized 
notifications 22. For example, one or more notifications 32 received from an e-mail 
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source maybe assigned to a green sector, wherein the prioritized notifications 22 which 
are related to the notifications 32 can be associated with one or more display objects that 
are located within and about the green sector according to the assigned priority of the e- 
mail provided by the priorities system 30. 
5 In accordance with one particular aspect of the present invention, the display can 

be arranged as a circular scope having one or more concentrically located divisions on the 
scope. The radius of respective rings can vary from sector to sector in order to 
accommodate different numbers of objects in division for the associated sector. The 
display objects associated with a higher assigned priority can be located in one division or 

10 boundary of the associated sector (e.g., closer to center), whereas display objects 

associated with a lower priority can be located in another division (e.g., outer edges of 
display) — or vice versa. 

It is to be appreciated that there can be a plurality of such sectors, display objects, 
divisions, colors, shapes, and dimensions as will be described in more detail below. It is 

1 5 also to be appreciated that a scope is just one of but many possible arrangements in 

accordance with the present invention. For example, display objects can be arranged on a 
horizon, wherein display objects appearing closer can be considered as higher priority and 
objects appearing further on the horizon can be associated with lower priorities. This can 
also include locating display objects on the horizon based on time, for example, wherein 

20 newer or older notifications 32 are located according the recentness of the notification 

(e.g., left, right, center, farther, and closer on the horizon based on the time the 
notification was received). Other dimensions can also be displayed to reflect the time or 
priority of the notifications 32. For example, one or more displays can be provided that 
can be arranged as three-dimensional layers of display (e.g., layers arranged as partially or 

25 transparently overlapping and/or directed toward or away the user), wherein respective 

layers can indicate display objects with varying degrees of priorities and/or varying 
degrees of elapsed time from when the notifications 32 were received. 

It is noted that the output 36 can also be provided to users according to other 
indications. For example, if a high priority notification 22 were to be received, a loud or 

30 repetitive sound can be rendered, whereas if a lower priority message were received, a 
lower volume/less repetitive sound can be rendered. This can also include an actual 
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rendering of the notification 32 or summary of the notification such as playing an audio 
feed of the notification 32 or providing audio information such as "Message from home." 

The output 36 can also include physical renderings associated with priority such as 
controlling the repetition of and/or intensity of vibrations of a hand held device such as a 
5 cell phone or pager. 

In accordance with another aspect of the present invention, the user interface 20 
can receive and respond to user input 38. This can include mouse clicking, keyboard 
strokes, verbal commands and/or other user context indications. For example, a display 
object can be selected via a mouse and provide a summary of the underlying notification 

1 0 32. Further user actions can "drill-down" to the actual notification as desired. The user 

input 38 can also be utilized to re-size, alter, move, close, and open the display described 
above and/or alter the characteristics of the display such as switching from two 
dimensional to a three dimensional display and/or switching from source display to 
domain display. This can also include providing feedback 40 from the user interface 20 

1 5 to the notification manager 24 and/or the priorities system 30 based upon the user input 

38. The feedback 40 can include indications of the user's preferences regarding assigned 
priorities and/or the notifications 22 and can include implicit and/or explicit reactions of 
the user that can be utilized to adjust/configure the notification manager 24 and/or the 
priorities system 30 as will be described in more detail below. 

20 Figs. 2, 3 and 4 illustrate methodologies for providing a user interface in 

accordance the present invention. While, for purposes of simplicity of explanation, the 
methodologies are shown and described as a series of acts, it is to be understood and 
appreciated that the present invention is not limited by the order of acts, as some acts 
may, in accordance with the present invention, occur in different orders and/or 

25 concurrently with other acts from that shown and described herein. For example, those 

skilled in the art will understand and appreciate that a methodology could alternatively be 
represented as a series of interrelated states or events, such as in a state diagram. 
Moreover, not all illustrated acts may be required to implement a methodology in 
accordance with the present invention. 
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Referring now to Fig. 2, a block diagram illustrates an interface 50 and associated 
methods in accordance with an aspect of the present invention. The interface 50 can 
provide one or more aspects 52-72 to provide notifications and updates over time in a 
pleasant, timely and non-intrusive manner. As described above, this can include visual, 
5 audio, and/or physical renderings depicted at 52 that are associated with the notifications 

having priorities associated therewith. At 54, this can include drilling down for more 
detailed information regarding a respective notification that is associated with a display 
object. For example, this can include semantic zooming, wherein more detail is provided 
at each level of a user directed zooming operation (e.g., initiated by mouse, keyboard, 

1 0 audio commands and/or inputs providing indications of the user's visual patterns) until 

the full text or audio of the notification is rendered. At 56, mapping and priority rules are 
provided. This includes rules that direct how respective notifications are associated with 
a display object and are located on a display, for example. As an example, one or more 
rules can be provided that direct/map notifications from a particular source or domain to 

1 5 an area or sector of a display and associates the notification to a display object, wherein a 

priority rule can direct and/or map the display object within the sector or area of display 
based upon the assigned priority of the notification. For example, higher priority items 
can be mapped near the center of a display and lower priority items can be mapped to 
outer areas of the display. It is to be appreciated that a plurality of other mappings/rules 

20 are possible such as mapping higher priority items to the outer area of the display. 

At 58, implicit and/or explicit feedback is provided from the interface 50 to the 
notification and/or priorities systems described above. Implicit feedback can include such 
actions as how fast a user responds to or reads a selected notification, including delays 
with interacting with a notification and whether or not a notification is deleted or saved. 

25 Explicit feedback can include direct user actions that indicate there may be some 

disagreement with the assigned priority or other display characteristic. For example, if a 
notification were assigned a high priority, and the user disagreed with the assignment, the 
user could drag the display object (or provide other indication, e.g., keyboard, voice) 
associated with the high priority notification to a portion of the display having lower 

30 priority, thus explicitly indicating to the system that messages from a particular source, 
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domain, individual or content type should be classified to a different priority. Thus, 
these types of feedback can provide information to the notification manager 24 and/or 
priorities system 30 to alter and/or adjust decision-making processes within these systems 
in accordance with a user's implied and/or explicit desires. 
5 At 60, proximity mapping can be provided with the display objects associated 

with the user interface 50. As an example, meaning can be provided to the user based 
upon how one or more display objects are grouped and/or clustered. A tightly packed 
grouping can indicate an increasing density of notifications from a source or domain 
whereas a sparser grouping can indicate less activity. Proximity can also reflect such 

1 0 parameters as time or priority and/or can indicate that one or more display objects are 

combinations of more than one notification, wherein the display object can first be 
selected by the user with a subsequent drill-down for a particular notification. 

At 62, the interface 50 can also provide notification change information overtime 
to enable users to receive glancable updates of items that arrived while they were away 

1 5 and/or busy with other activities. This can include providing a fast-forward or instant 

replay selection, wherein the user can quickly review a stored sequential display of how 
incoming notifications were received over time. Fading or decay options can be provided 
with the display objects to indicate how unattended notifications become stale over time. 
For example, if a notification were received that a meeting was scheduled at 2:00, the 

20 display object associated with the notification can begin to fade or decay as time passes 
after 2:00 and the notification has not been attended by the user. Other indications can 
include different colorings and/or shape alterations. Other examples include brightening 
and darkening display objects based upon the assigned priority. 

At 64, summary views and/or other adjustable characteristics can be provided by 

25 the interface 50. This can include providing a summary of the notification based upon a 
mouse-over action by the user. This can also include providing more or less displayed 
information based upon a resizing the display or portions thereof and will be described in 
more detail below. At 66, sector and sub-sector mapping is provided. This can include 
defining particular regions of a display to occupy a shape such as a wedge and associate 

30 the wedge with a source or a domain, for example. The shape can be further divided 

according to the assigned priorities of the received notifications, wherein display objects 



12 



MS 150900. 15 



relating to the notifications are located within the sectors according to the assigned 
priority. 

At 68, multiple shapes, objects, colors and dimensions are utilized to provide 
renderings to the user indicative of the notification and/or priority. For example, one or 
5 more sectors can be populated with circles, squares, rectangles, triangles or substantially 

any shape (e.g., icon). The sectors, which can also be referred to as display objects, can 
also be rendered in three dimensions such as a funnel or cylindrical shape. As an 
example, a circular arrangement of wedges can appear as a circle, whereas if depth were 
added to the display the wedges can appear as a funnel or parabolic shape. Display 

10 objects, sometimes referred to as glyphs or globs, within the sectors can be two or three- 

dimensional renderings similar to the sectors and/or provided as spheres, cubes, cylinders, 
or other shapes. The sectors can be divided according to priority in a plurality of patterns 
such as concentric circles, squares, rectangles, triangles, wherein display objects are 
located according to the assigned priorities. As can be appreciated, multiple colors and/or 

1 5 shadings can be provided to differentiate various sectors and display objects. It is noted 

that multiple qualities of an item, such as shape, size, color, and/or position, for example, 
can also be animated through a sequence to differentiate that item from other items. 

At 70, adjustments and/or selections are provided to the user to enable alteration 
of the size and shape or movement of the display and to provide for adjustments to 

20 priorities as described above. This can be achieved by utilizing substantially any graphics 

tool for rendering, mapping, sizing, shaping, and/or dimensioning objects on the display 
such as vector graphics, for example, to enable user configure-ability and alteration of the 
display. At 72, domain, source and priority mapping is provided to enable display objects 
to be associated with a notification and enable mapping of the display object to a sector 

25 associated with a particular domain or source, and to enable mapping of the object within 
the sector based upon the assigned priority of the notification. 

Turning now to Fig. 3, a flow diagram illustrates one or more clustering/de- 
clustering options/strategies for displaying objects in accordance with the present 
invention. When multiple display items are rendered to a constrained space, for 

30 example, the methodology depicted in Fig. 3 provides one or more possibilities for 

organizing and displaying the objects. For example, at 80, fitting rules can be provided. 
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This may include rules such as "dropping out" or removing display objects over time as 
newer notifications arrive. This can also include overlapping display objects. Another 
rule can enable displaying only the number of objects that can fit in a designated space 
and then replacing display objects with more recent display objects after notifications 
5 have been reviewed, selected, inspected, or deleted by the user. Still yet another rule or 

algorithm can provide for mapping priority to a location to prevent overlap of objects. 
This can include a force directed layout to enable items to rearrange when the items 
become more or less crowded. In addition, decisions can be made such that the "Top N 
items should not be elided", wherein N is an integer. At 82, another rule can include 

1 0 defining meta items for a display object. In other words, a display object can itself be 

representative of one or more other notifications. Thus, multiple notifications from 
person "X" and from source "Y" could be clustered under a single display object 
identified as from person X. The user can subsequently receive the individual 
notifications associated with the meta item by such actions as mouse-clicking and drilling 

1 5 down on the meta item, for example. At 84, a third dimension can be utilized to display 

objects. This can include displaying multiple layers of display objects and/or stacking 
objects in visual directions to and from the user. 

Referring now to Fig. 4, a flow diagram illustrates one particular aspect of the 
present invention for mapping notifications to a display. It is to be appreciated that a 

20 plurality of other methods are possible. At 90 received notifications or other information 

are assigned priorities and collected and/or aggregated at a system such as a server and/or 
other aggregating system. At 92, the aggregated notifications are converted to a code 
such as XML. It is to be appreciated other conversions are possible. At 94, the converted 
notifications are passed to an interface. At 96, the notifications and priorities are 

25 associated with or mapped to items such as display objects and/or display locations in 

accordance with the priority, source, class and/or domain of the received notifications. 

Referring to Fig. 5, an exemplary scope display 100 is illustrated in accordance 
with the present invention. It is to be appreciated that the display 100 is but one of many 
possible display configurations that are in the spirit of the concepts previously described. 

30 For example, the display 100 can be arranged in a circular pattern of various colored 

wedges 102-108 having one or more spherical display objects {e.g., reference 1 10) that 
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are associated with one or more prioritized notifications and/or other information such as 
the status of incoming appointments or background tasks. The display 1 00 includes a 
crystal/transparent scope cover 112 that appears over the display objects and wedges 102- 
1 08 in a third dimension toward the user. For clarity, the third dimension of the scope 
5 1 1 2 is illustrated from a side view as a dome-shaped structure at reference 116. As 

illustrated, the scope 1 12 is divided into sections according to one or more concentric 
circles 120 and 122 that indicate priority boundaries within each wedge 102-108. For 
example, display objects appearing within the circle defined by 122 can represent high 
priority notifications, whereas display objects further away from center can be represented 

1 0 as lower priority items. It is to be appreciated that other arrangements are possible as 

described above (e.g., low priority objects toward center), and that the division into 
wedges or sectors is not limited to any specific number. 

The wedges 1 02-1 08 can be associated with one or more sources or domains. In 
the illustrated example, sources such as inbox, alerts, tasks, and calendar are provided. 

15 Input selections 126-129 are provided to enable further configurations of the sources or 

domains and/or to view an aggregate of the one or more notifications associated with the 
selected source or domain. Selecting the display object such as 110, for example, enables 
a particular notification or meta item within the "inbox" wedge to be reviewed and/or 
drilled-down for more information. In addition, audio renderings can be initiated when 

20 the display objects are selected. As described above, this can include actual audio 

renderings of text and/or audio associated with the notifications and/or can include audio 
'beeps" or "clicks" such as when a mouse is hovered over the display object, for example. 

One or more scope configuration selections 134 can also be provided. These can 
include selection options such as close scope, change dimensional view of the scope, 

25 switch from source view to domain view on the wedges, select transparent mode, fast- 

forward, replay and configuring priority/notification options. As will be illustrated in 
more detail below, the scope 112 provides re-sizing capabilities over the entire portion 
and/or selected portions of the scope, such as can be initiated by dragging and selecting a 
mouse on the scope or portions thereof, for example. Some objects such as display 

30 objects 136 and 138, for example, may appear somewhat differently due to specular 
highlighting utilized on the scope 1 12. 
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According to another aspect of the present invention, the scope 1 00, can include 
one or more buttons (not shown) on the perimeter of wedges 102-108 that filter the views 
within the wedge by highlighting particular properties of items. For example, a user can 
click a button on the wedge 102-108 that filters e-mail by adding special colors to those 
5 e-mails that are "just to me" versus to me and others, or larger e-mail aliases. This can 

similarly be applied to e-mails that contain attachments that are from people on my team, 
for example. These filters can be overlayed as multiple dimensions of color, shape, 
attached icons, and so forth and the buttons can be toggled on and off. 

Referring now to Figs. 6 and 7, exemplary three-dimensional displays are 

10 illustrated in accordance with the present invention. Fig. 6 illustrates a display 140 as 

viewed from an angle, whereas Fig. 7 illustrates a display 141 with a "twist" applied to it. 
The twist enables providing more area for containing objects near the periphery of the 
display 141. As depicted in Fig. 6, display objects (e.g., 142) are concentrically located 
within one or more wedges 144-150 that are mapped to the display 140 according to 

1 5 notification priorities and the respective source or domain associated with the display 

objects. The view represented in Figs. 6 and 7 provides a conic or parabolic view, 
although, it is to be appreciated that other three-dimensional renderings are possible such 
as cylindrical, cubicle, pyramidal, spherical and so forth. Histogram displays can also be 
provided/selected, wherein a gradated fill can be applied to the background of different 

20 regions of the display, whereby the intensity or color of the background at different areas 
indicates a number of items at that location. In addition, contouring can be utilized to 
provide a topological view of display objects across various sources, domains, classes 
and/or priorities. 

Referring to Figs. 8 and 9, an illustration is provided how the scope 1 12 depicted 
25 in Fig. 5 can be selectively adjusted/altered and employed in a training scenario (e.g., 

explicit training as described above) by the user (e.g., mouse selection and drag). 
Generally, the user cannot directly manipulate items - they are locked and their position 
is procedurally specified by the underlying software as a function of item type and 
priority. There are cases whereby the user may want to override this automatic 
30 categorization. To do this the user has to unlock the items for editing. One possible 

metaphor for this is that the user can open the "cover" on the scope 1 12, thus unlocking 
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items. After direct manipulation of items is complete, the user then closes the "cover", 
thus again locking the items. As described above, the user's indication or override of the 
automatic categorization can be provided to the notification manager and/or prioritization 
system as feedback to tune or modify decision-making processes within these systems. 
5 Figs. 10 and 11, illustrate various alternative display configurations in accordance 

with the present invention. A motivation for these alternative displays is to provide more 
space for higher priority items near the center of the displays. For example, in Fig. 1 0, a 
spiral display 154 having five sectors is illustrated. At 155, an interlocking sector 
arrangement is provided. At 156, individual wedges are further subdivided according to 

1 0 priority. At 1 57, a star shaped pattern is provided to define priority regions for one or 

more display objects. At 158, an alternative interlocking display subdivided according to 
priority is illustrated. Fig. 1 1 also provides various patterns that can be employed in 
accordance with the present invention. In particular, at 160, display object sizes are 
adjusted according to the assigned priority, wherein larger objects having higher priority 

1 5 are arranged near the outer portion 1 62 of the scope; the arrangement is intended to 

suggest the view into a funnel, with the center receding from the user. In contrast, a 
display 164 provides the larger, higher priority objects closer to the center of the display. 

Figs. 12 and 13 illustrate how various portions of the display 100 depicted in Fig. 
5 can be utilized. It is noted that Figs. 12 and 13 depict two exemplary "frames" from an 

20 ongoing animation that enlarges a sector 170 of the scope 100. In this particular 

animation, the user does not necessarily resize wedges utilizing drag and drop, for 
example; instead, there can be a toggle button {e.g., mouse click, input selection 
associated with the scope or portions thereof) that will enlarge one wedge and shrink the 
rest of the scope to make space for the wedge as depicted at 172 and 173 of Fig. 13. In an 

25 alternative aspect, the scope 1 00 can remain the same size and users can drag the 

boundaries of the wedges in order to occupy a larger arc. It is also noted that display 
items may reveal more detail when the wedge 170, 1 72 is enlarged. Such detail may 
include properties of the item (e.g., sender, item size, whether or not documents are 
attached, whether the user is the sole recipient or the item was sent to a group), or the 

30 detail might reveal more of the actual content of the item. 
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Figs. 14-17 are part of an exemplary animation. A "note" 176 is moving from the 
right of the scope 1 00 into view in Fig. 1 4 and illustrated at 1 77 in Fig. 1 5, and settles to 
reveal detail of an inspected item 172 in Fig. 17 such as a crystal ball view, wherein 
further detail can be viewed if desired via selection tab 173. Fig 16 illustrates the start of 
5 an item 178 departing in an animated move towards the left. Referring back to Fig. 1 4, 

an item or display object 1 80 is touched by a user via a mouse or other selection device to 
be opened. Fig. 14 also illustrates how the display 100 can change over time. For 
example, the display object 1 80 is depicted as brighter or hotter than other display 
objects. As described above, this can occur, for example, if an urgent or other 
1 0 notification were to go un-reviewed or unattended over time. Alternatively, this can 

indicate that the object 1 80 is the most or least important (or other distinction) object 
within the wedge or area associated with the display object 1 80. 

Fig. 18 illustrates how a mouse-over, depicted at display object 190, can provide a 
summary view 1 92 of the associated notification. It is noted that if re-sizing occurs on 
1 5 the overall display 100 and/or on object s/sectors therein, that more or less summary 

information can be provided, if not the entire notification, during a mouse-over or other 
user-directed interaction. 

It is noted that other information and/or notifications can be prioritized and 
displayed in accordance with the present invention. For example, this can include 

20 background queries {e.g., while the user is working, text that the user is currently working 

on may be reviewed, such that background queries regarding the text are formulated and 
issued to search engines), and scheduling tasks from a scheduling and/or other program. 
Information or notification sources can themselves be push-type or pull-type sources. 
Push-type sources are those that automatically generate and send information without a 

25 corresponding request, such as headline news and other Internet-related services that send 

information automatically after being subscribed to. Pull-type sources are those that send 
information in response to a request, such as e-mail being received after a mail server is 
polled. Still other information sources can include the following: 

• Personal information management applications such as calendar systems; 

18 



MS 150900. 15 



• Computer systems {e.g., that may alert the user with messages that information 

about alerts about system activity or problems); 

• Internet-related services, appointment information, scheduling queries; 

• Changes in documents or numbers of certain kinds of documents in one or more 
5 shared folders; 

• Availability of new documents in response to standing or persistent queries for 
information; 

• Information sources for information about people and their presence, their change 
in location, their proximity (e.g., let me know when I am traveling if another 

10 coworker or friend is within 10 miles of me"), or their availability (e.g., let me 

know when Steve is available for a conversation and is near a high-speed link that 
can support full video teleconferencing"); 

• Program source code changes being checked in to a source code repository 
database; 

1 5 • Level of activity or computed level of relevance of such activity on a mailing list, 

in a discussion board, or in an online conversation (chat room); 

• Investments (stocks) reaching a price level deemed to be interesting (e.g., an 
unusual high or low price); and/or 

• Real-time information sources on the Internet, such as traffic congestion, storm 
20 warnings, and so forth. 

In order to provide a context for the various aspects of the invention, Fig. 19 and 
the following discussion are intended to provide a brief, general description of a suitable 
computing environment in which the various aspects of the present invention may be 
implemented. While the invention has been described above in the general context of 
25 computer-executable instructions of a computer program that runs on a computer and/or 

computers, those skilled in the art will recognize that the invention also maybe 
implemented in combination with other program modules. Generally, program modules 
include routines, programs, components, data structures, etc. that perform particular tasks 
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and/or implement particular abstract data types. Moreover, those skilled in the art will 
appreciate that the inventive methods may be practiced with other computer system 
configurations, including single-processor or multiprocessor computer systems, 
minicomputers, mainframe computers, as well as personal computers, hand-held 
5 computing devices, microprocessor-based or programmable consumer electronics, and 

the like. The illustrated aspects of the invention may also be practiced in distributed 
computing environments where tasks are performed by remote processing devices that are 
linked through a communications network. However, some, if not all aspects of the 
invention can be practiced on stand-alone computers. In a distributed computing 
1 0 environment, program modules may be located in both local and remote memory storage 
devices. 

With reference to Fig. 1 9, an exemplary system for implementing the various 
aspects of the invention includes a computer 720, including a processing unit 72 1 , a 
system memory 722, and a system bus 723 that couples various system components 
1 5 including the system memory to the processing unit 72 1 . The processing unit 72 1 may 

be any of various commercially available processors. It is to be appreciated that dual 
microprocessors and other multi-processor architectures also may be employed as the 
processing unit 721 . 

The system bus may be any of several types of bus structure including a memory 
20 bus or memory controller, a peripheral bus, and a local bus using any of a variety of 
commercially available bus architectures. The system memory may include read only 
memory (ROM) 724 and random access memory (RAM) 725. A basic input/output 
system (BIOS), containing the basic routines that help to transfer information between 
elements within the computer 720, such as during start-up, is stored in ROM 724. 
25 The computer 720 further includes a hard disk drive 727, a magnetic disk drive 

728, e.g., to read from or write to a removable disk 729, and an optical disk drive 730, 
e.g., for reading from or writing to a CD-ROM disk 73 1 or to read from or write to other 
optical media. The hard disk drive 727, magnetic disk drive 728, and optical disk drive 
730 are connected to the system bus 723 by a hard disk drive interface 732, a magnetic 
30 disk drive interface 733, and an optical drive interface 734, respectively. The drives and 

their associated computer-readable media provide nonvolatile storage of data, data 



20 



MS 150900. 15 



structures, computer-executable instructions, etc. for the computer 720. Although the 
description of computer-readable media above refers to a hard disk, a removable 
magnetic disk and a CD, it should be appreciated by those skilled in the art that other 
types of media which are readable by a computer, such as magnetic cassettes, flash 
5 memory cards, digital video disks, Bernoulli cartridges, and the like, may also be used in 

the exemplary operating environment, and further that any such media may contain 
computer-executable instructions for performing the methods of the present invention. 

A number of program modules may be stored in the drives and RAM 725, 
including an operating system 735, one or more application programs 736, other program 
10 modules 737, and program data 738. It is noted that the operating system 735 in the 
illustrated computer may be substantially any suitable operating system. 

A user may enter commands and information into the computer 720 through a 
keyboard 740 and a pointing device, such as a mouse 742. Other input devices (not 
shown) may include a microphone, a joystick, a game pad, a satellite dish, a scanner, or 
15 the like. These and other input devices are often connected to the processing unit 721 

through a serial port interface 746 that is coupled to the system bus, but maybe connected 
by other interfaces, such as a parallel port, a game port or a universal serial bus (USB). A 
monitor 747 or other type of display device is also connected to the system bus 723 via an 
interface, such as a video adapter 748. In addition to the monitor, computers typically 
20 include other peripheral output devices (not shown), such as speakers and printers. 

The computer 720 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote computer 749. The 
remote computer 749 may be a workstation, a server computer, a router, a peer device or 
other common network node, and typically includes many or all of the elements described 
25 relative to the computer 720, although only a memory storage device 750 is illustrated in 

Fig. 19. The logical connections depicted in Fig. 19 may include a local area network 
(LAN) 751 and a wide area network (WAN) 752, Such networking environments are 
commonplace in offices, enterprise-wide computer networks, Intranets and the Internet. 

When employed in a LAN networking environment, the computer 720 may be 
30 connected to the local network 75 1 through a network interface or adapter 753. When 

utilized in a WAN networking environment, the computer 720 generally may include a 
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modem 754, and/or is connected to a communications server on the LAN, and/or has 
other means for establishing communications over the wide area network 752, such as the 
Internet. The modem 754, which may be internal or external, may be connected to the 
system bus 723 via the serial port interface 746. In a networked environment, program 
5 modules depicted relative to the computer 720, or portions thereof, may be stored in the 
remote memory storage device. It will be appreciated that the network connections 
shown are exemplary and other means of establishing a communications link between the 
computers may be employed. 

In accordance with the practices of persons skilled in the art of computer 

1 0 programming, the present invention has been described with reference to acts and 

symbolic representations of operations that are performed by a computer, such as the 
computer 720, unless otherwise indicated. Such acts and operations are sometimes 
referred to as being computer-executed. It will be appreciated that the acts and 
symbolically represented operations include the manipulation by the processing unit 721 

1 5 of electrical signals representing data bits which causes a resulting transformation or 

reduction of the electrical signal representation, and the maintenance of data bits at 
memory locations in the memory system (including the system memory 722, hard drive 
727, floppy disks 729, and CD-ROM 731) to thereby reconfigure or otherwise alter the 
computer system's operation, as well as other processing of signals. The memory 

20 locations wherein such data bits are maintained are physical locations that have particular 

electrical, magnetic, or optical properties corresponding to the data bits. 

Referring to Fig. 20, a diagram of an exemplary computerized device 800 that can 
be employed in conjunction with various aspects of the present invention is illustrated. 
The computerized device 800 can be, for example, a desktop computer, a laptop 

25 computer, a personal digital assistant (PDA), a cell phone, watch and so forth; the 

invention is not so limited. Those skilled in the art will appreciate that the invention may 
be practiced with other computer system configurations, including hand-held devices, 
multiprocessor systems, microprocessor-based or programmable consumer electronics, 
network PC's, minicomputers, mainframe computers, and the like. The invention may 

30 also be practiced in distributed computing environments wherein tasks are performed by 

remote processing devices that are linked through a communications network. 
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The device 800 includes one or more of the following components: processor(s) 
802, memory 804, storage 806, a communications component 808, input device(s) 810, a 
display 812, and output device(s) 814. It is noted, that for a particular instantiation of the 
device 800, one or more of these components may not be present. For example, a PDA 
5 may not have any output device(s) 814, while a cell phone may not have storage 806, etc. 

Thus, the description of the device 800 is to be utilized as an overview as to the types of 
components that typically reside within such a device 800, and is not meant as a limiting 
or exhaustive description of such computerized devices. 

The processor(s) 802 may include a single central-processing unit (CPU), or a 
10 plurality of processing units, commonly referred to as a parallel processing environment. 
The memory 804 may include read only memory (ROM) and/or random access memory 
(RAM). The storage 806 may be any type of storage, such as fixed-media storage devices 
such as hard disk drives, flash or other non-volatile memory, as well as removable-media 
storage devices, such as tape drives, optical drives like CD-ROM's, floppy disk drives, 
1 5 etc. The storage and their associated computer-readable media provide non-volatile 

storage of computer-readable instructions, data structures, program modules and other 
data. It should be appreciated by those skilled in the art that any type of computer- 
readable media which can store data that is accessible by a computer, such as magnetic 
cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access 
20 memories (RAMs), read only memories (ROMs), and the like, may be employed. 

Because the device 800 may operate in a network environment, such as the 
Internet, intranets, extranets, local-area networks (LAN's), wide-area networks (WAN's), 
etc., a communications component 808 can be present in or attached to the device 800. 
Such a component 808 may be one or more of a network card, such as an Ethernet card, 

25 an analog modem, a cable modem, a digital subscriber loop (DSL) modem, an Integrated 

Services Digital Network (ISDN) adapter, etc.; the invention is not so limited. 
Furthermore, the input device(s) 810 are the mechanisms by which a user indicates input 
to the device 800. Such device(s) 810 include keyboards, pointing devices, microphones, 
joysticks, game pads, satellite dishes, scanners, etc. The display 812 is how the device 

30 800 typically directs output to the user, and can include, for example, cathode-ray tube 
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(CRT) display devices, flat-panel display (FPD) display devices, etc. In addition, the 
device 800 may indicate output to the user via other output device(s) 814, such as 
speakers, printers, etc. 

What has been described above are preferred aspects of the present invention. It 
5 is, of course, not possible to describe every conceivable combination of components or 

methodologies for purposes of describing the present invention, but one of ordinary skill 
in the art will recognize that many further combinations and permutations of the present 
invention are possible. Accordingly, the present invention is intended to embrace all such 
alterations and variations that fall within the spirit and scope of the appended claims. 
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